Add duplicate issue cleanup to CI failure doctor workflow #14396

Copilot · 2026-02-07T17:09:24Z

CI failure doctor now searches for and closes older duplicate issues to reduce issue tracker noise.

Changes

Added update-issue safe output to enable programmatic issue closure
Enhanced Phase 6 with duplicate detection logic:
- Searches for existing issues with label "cookie" and "[CI Failure Doctor]" prefix
- Closes older duplicates using update-issue tool with state: "closed" and state_reason: "not_planned"
- Links closed duplicates to new investigation for traceability
- Skips new issue creation if very recent duplicate exists (<1 hour old)
Renamed Phase 6 → Phase 7 (Reporting and Recommendations) to maintain logical flow

Example behavior

When CI failure doctor runs:

# Old behavior: Creates new issue every time
Issue #123: [CI Failure Doctor] js jobs failing
Issue #124: [CI Failure Doctor] js jobs failing  # Duplicate!
Issue #125: [CI Failure Doctor] js jobs failing  # Another duplicate!

# New behavior: Closes older duplicates automatically
Issue #123: [CI Failure Doctor] js jobs failing [CLOSED - duplicate]
Issue #124: [CI Failure Doctor] js jobs failing [CLOSED - duplicate]
Issue #125: [CI Failure Doctor] js jobs failing [OPEN - with links to #123, #124]

The workflow intelligently distinguishes between true duplicates (same root cause) and distinct failures (different components/errors).

Original prompt

This section details on the original issue you should resolve

<issue_title>[CI Failure Doctor] 🏥 CI Failure Investigation - Run #34273</issue_title>
<issue_description>## Summary
js and js-integration-live-api jobs now fail because the new frontmatter hash regression tests expect the JavaScript implementation to match the Go hash for .github/workflows/audit-workflows.md after the runtime deduplication change.

Failure Details

Run: 21783296217
Commit: c895fa5f428d42b5c0f9bd95b8187c40158cf7a7
Trigger: push to main

Root Cause Analysis

The Go implementation of ComputeFrontmatterHash now produces ff56a35b191afe28f76a09217de1597695a225e8f41502cc815a0a9e0eb2f96e for audit-workflows.md (after the recent runtime deduplication work), but the pure JavaScript implementation in actions/setup/js/frontmatter_hash_pure.cjs still builds a much simpler canonical representation (only frontmatter-text, imports, imported frontmatters, and template expressions). The new regression test asserts jsHash === goHash and now fails because the JS algorithm never incorporated the merged runtime/tool deduplication strings that the Go canonical JSON now includes.

Failed Jobs and Errors

js → npm test -- frontmatter_hash_github_api.test.cjs
- Fails in frontmatter_hash_github_api.test.cjs > frontmatter_hash with GitHub API > cross-language validation > should compute same hash as Go implementation when using file system
- Assertion: expected JavaScript hash bb5cbd9... to be Go hash ff56a35...
js-integration-live-api → same npm test executed with live API flag and identical assertion failure (same expected/received hashes).

Investigation Findings

actions/setup/js/frontmatter_hash_pure.cjs exported helper computeFrontmatterHash that still canonicalizes only the text-based frontmatter, imports, and template expressions; it never replays Go’s field merging or merged runtimes/tools strings that were touched by the runtime deduplication change.
As a result the canonical JSON hash from JS remains bb5cbd9552401591e9476ae803f1736a88dca3f654f725dadffa5a7dbc31d639 while Go now outputs ff56a35b191afe28f76a09217de1597695a225e8f41502cc815a0a9e0eb2f96e.
Both failing jobs run npm test -- frontmatter_hash_github_api.test.cjs (the second adds a live GitHub API run) and reproduce the diff reliably.

Recommended Actions

Update actions/setup/js/frontmatter_hash_pure.cjs (and any wrappers used by frontmatter_hash.cjs) so the canonical JSON matches Go’s buildCanonicalFrontmatter output (including merged runtimes, services, tools, etc.). The cross-language test should no longer fail once Go and JS canonical representations align.
Recompute the JavaScript hash after the change (e.g., cd actions/setup/js && npm test -- frontmatter_hash_github_api.test.cjs) and ensure both jobs pass before rerunning CI.
Consider calling the Go binary directly from JavaScript if implementing the full canonicalization in JS becomes too costly; the regression test would then pass because Go’s output is used as the source of truth.

Prevention Strategies

Keep the JavaScript canonicalization logic in sync with pkg/parser/frontmatter_hash.go, especially after future runtime or imports deduplication changes.
Add a regression guard that recomputes the hash for a small subset of real workflows whenever the canonical fields change.
Document the frontmatter hash spec in FRONTMATTER_HASH_SUMMARY.md so JS engineers can replicate Go’s field merging behavior.

AI Team Self-Improvement

When runtime deduplication or merged field logic changes are introduced in Go, remind yourself to re-run the JavaScript regression tests (npm test -- frontmatter_hash_github_api.test.cjs) and align frontmatter_hash_pure.cjs with whatever canonical JSON pkg/parser/frontmatter_hash.go now emits.

Historical Context

The frontmatter hash cross-language mismatch has been known (see FRONTMATTER_HASH_SUMMARY.md), but this is the first time a regression test validates audit-workflows.md directly against Go’s output; the new runtime deduplication work changed Go’s hash, so the previously simplified JS implementation is now too far out of sync.

AI generated by CI Failure Doctor

To add this workflow in your repository, run gh aw add githubnext/agentics/workflows/ci-doctor.md@ea350161ad5dcc9624cf510f134c6a9e39a6f94d. See usage guide.

expires on Feb 8, 2026, 4:53 PM UTC

Comments on the Issue (you are @copilot in this ...

Fixes [CI Failure Doctor] 🏥 CI Failure Investigation - Run #34273 #14387

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

- Add update-issue safe output permission - Update Phase 6 to include logic for closing older duplicate issues - Rename Phase 6 to Phase 7 (Reporting and Recommendations) Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot

Pull request overview

This PR updates the CI Failure Doctor agentic workflow to support duplicate-issue cleanup by enabling an update-issue safe output and revising the runbook to search for existing issues, close older duplicates, and renumber later phases.

Changes:

Added update-issue to the workflow’s safe-outputs so the agent can programmatically update/close issues.
Expanded Phase 6 guidance to search for duplicates, close older ones, and skip creating a new issue if a very recent duplicate exists.
Regenerated the compiled lockfile to include the new safe output/tool schema updates.

Reviewed changes

Copilot reviewed 2 out of 3 changed files in this pull request and generated 3 comments.

File	Description
pkg/parser/import_processor.go	Minor formatting/whitespace alignment in import processing output struct population.
.github/workflows/ci-doctor.md	Enables `update-issue` and updates the workflow instructions/phases for duplicate handling.
.github/workflows/ci-doctor.lock.yml	Updates compiled safe-outputs configuration and tool definitions to include `update_issue`.

Comments suppressed due to low confidence (1)

.github/workflows/ci-doctor.lock.yml:1272

GH_AW_SAFE_OUTPUTS_HANDLER_CONFIG enables update_issue with only {max:1}; without allow_status/target flags this won’t be able to close duplicates (and won’t run outside issue context). Regenerate the lockfile after updating the workflow frontmatter so this env config includes the needed allow_status and target values (and a higher max if multiple duplicates should be processed).

        env:
          GH_AW_AGENT_OUTPUT: ${{ env.GH_AW_AGENT_OUTPUT }}
          GH_AW_SAFE_OUTPUTS_HANDLER_CONFIG: "{\"add_comment\":{\"max\":1},\"create_issue\":{\"expires\":24,\"labels\":[\"cookie\"],\"max\":1,\"title_prefix\":\"[CI Failure Doctor] \"},\"missing_data\":{},\"missing_tool\":{},\"update_issue\":{\"max\":1}}"
        with:

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot · 2026-02-07T17:31:56Z

.github/workflows/ci-doctor.md

    title-prefix: "[CI Failure Doctor] "
    labels: [cookie]
  add-comment:
+  update-issue:


safe-outputs.update-issue: is enabled but not configured to actually allow any updates. In this codebase, update permissions are granted by the presence of status:, title:, and/or body: keys, and the default target is triggering (which will be skipped for this workflow since it runs on workflow_run). To make duplicate-closure possible, configure update-issue with at least status: enabled and set target: "*" (so the agent can specify issue_number), and consider raising max above 1 if you expect closing multiple duplicates per run.

Suggested change

update-issue:

update-issue:

status:

target: "*"

max: 10

Copilot · 2026-02-07T17:31:56Z

.github/workflows/ci-doctor.md

+      - Add a comment explaining this is a duplicate of the new investigation
+      - Use the `update-issue` tool with `state: "closed"` and `state_reason: "not_planned"` to close them


The instructions mention calling update-issue with state and state_reason, but the safe output tool schema uses status (open/closed) and does not support state_reason. As written, the agent will generate invalid tool calls and fail to close duplicates. Update the guidance to use status: "closed" (and add rationale via add-comment) rather than state/state_reason.

Suggested change

- Add a comment explaining this is a duplicate of the new investigation

- Use the `update-issue` tool with `state: "closed"` and `state_reason: "not_planned"` to close them

- Add a comment explaining this is a duplicate of the new investigation and why you're closing it

- Use the `update-issue` tool with `status: "closed"` to close them

Copilot · 2026-02-07T17:31:56Z

.github/workflows/ci-doctor.lock.yml

          mkdir -p /tmp/gh-aw/mcp-logs/safeoutputs
          cat > /opt/gh-aw/safeoutputs/config.json << 'EOF'
-          {"add_comment":{"max":1},"create_issue":{"expires":24,"max":1},"missing_data":{},"missing_tool":{},"noop":{"max":1}}
+          {"add_comment":{"max":1},"create_issue":{"expires":24,"max":1},"missing_data":{},"missing_tool":{},"noop":{"max":1},"update_issue":{"max":1}}


In the compiled safe-outputs config JSON, update_issue is present but lacks allow_status and a non-triggering target. With this configuration, the update runner will refuse to apply status updates and will also skip entirely in a workflow_run context, so the workflow cannot actually close older duplicates. After fixing the frontmatter, recompile so update_issue includes allow_status: true, target: "*", and a max high enough to close multiple duplicates if desired.

This issue also appears on line 1269 of the same file.

Suggested change

{"add_comment":{"max":1},"create_issue":{"expires":24,"max":1},"missing_data":{},"missing_tool":{},"noop":{"max":1},"update_issue":{"max":1}}

{"add_comment":{"max":1},"create_issue":{"expires":24,"max":1},"missing_data":{},"missing_tool":{},"noop":{"max":1},"update_issue":{"allow_status":true,"target":"*","max":5}}

Initial plan

fed6e2a

Copilot AI assigned Copilot and pelikhan Feb 7, 2026

Copilot started work on behalf of pelikhan February 7, 2026 17:09 View session

Copilot AI changed the title ~~[WIP] Fix CI failure in JavaScript hash regression tests~~ Add duplicate issue cleanup to CI failure doctor workflow Feb 7, 2026

Copilot AI requested a review from pelikhan February 7, 2026 17:19

Copilot finished work on behalf of pelikhan February 7, 2026 17:19

pelikhan approved these changes Feb 7, 2026

View reviewed changes

pelikhan marked this pull request as ready for review February 7, 2026 17:28

Copilot AI review requested due to automatic review settings February 7, 2026 17:28

pelikhan merged commit c19426f into main Feb 7, 2026
1 check passed

pelikhan deleted the copilot/fix-js-integration-jobs branch February 7, 2026 17:28

Copilot started reviewing on behalf of pelikhan February 7, 2026 17:28 View session

Copilot AI reviewed Feb 7, 2026

View reviewed changes

github-actions bot mentioned this pull request Feb 8, 2026

🌱 Daily Team Evolution Insights - February 8, 2026 #14451

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add duplicate issue cleanup to CI failure doctor workflow #14396

Add duplicate issue cleanup to CI failure doctor workflow #14396

Uh oh!

Copilot AI commented Feb 7, 2026 •

edited

Loading

Uh oh!

Uh oh!

Copilot AI left a comment

Uh oh!

Copilot AI Feb 7, 2026

Uh oh!

Copilot AI Feb 7, 2026

Uh oh!

Copilot AI Feb 7, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

		- Add a comment explaining this is a duplicate of the new investigation
		- Use the `update-issue` tool with `state: "closed"` and `state_reason: "not_planned"` to close them

	{"add_comment":{"max":1},"create_issue":{"expires":24,"max":1},"missing_data":{},"missing_tool":{},"noop":{"max":1},"update_issue":{"max":1}}
	{"add_comment":{"max":1},"create_issue":{"expires":24,"max":1},"missing_data":{},"missing_tool":{},"noop":{"max":1},"update_issue":{"allow_status":true,"target":"*","max":5}}

Add duplicate issue cleanup to CI failure doctor workflow #14396

Add duplicate issue cleanup to CI failure doctor workflow #14396

Uh oh!

Conversation

Copilot AI commented Feb 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changes

Example behavior

Failure Details

Root Cause Analysis

Failed Jobs and Errors

Investigation Findings

Recommended Actions

Prevention Strategies

AI Team Self-Improvement

Historical Context

Comments on the Issue (you are @copilot in this ...

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI Feb 7, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 7, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 7, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Copilot AI commented Feb 7, 2026 •

edited

Loading